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ACRONYMS 


AVI Ashburn Vegetative Index 
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FAS Foreign Agricultural Service 

FCCAD Foreign Crop Condition Assessment Division 

GVI Green Vegetative Index 
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IMDACS Integrated Multivariate Data and Analysis Classification 

System 
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LAI Leaf Area Index 
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Vis Vegetative Indices 

VIN Vegetative Index Number 


1. INTRODUCTION 


1.1 PURPOSE 


The purpose of this paper is to document the application and 
evaluation of a masking technique as a feasible alternative to ground 
truth information for separating native vegetation* from cropland. 

1.2 SCOPE 

The scope of this document is primarily concerned with description of 
the approach which includes the data set, masking technique, and analysis 
methods and explanation of the results which includes the masking 
accuracy, error evaluation and time-profile comparisons. 

1.3 BACKGROUND 


The Early Warning/Crop Condition Assessment (EW/CCA) Research Project, in 
support of FAS/Crop Condition Assessment Division, is charged with developing 
and testing remote sensing techniques to make possible or to enhance 
operational methodologies for crop condition assessment (AgRISTARS Program 
Management Group). 

In response to the overall objective of this project, a task entitled 
Native Vegetation as an Indicator of Crop Moisture Condition was defined. The 
masking technique addressed in this report is an integral part of the 
preceding task. For approximately five years, USDA Foreign Agricultural 
Service, Foreign Crop Condition Assessment Division, has been utilizing the 
masking technique In their efforts to produce an estimate of crop condition in 
foreign areas. The masking technique is a relatively fast method for 
identifying an area or crop of interest within a LANDSAT MSS scene [Ashburn 
(1981)]. This technique is especially well adapted for use by the remote 
sensing analysts in an interactive computer operation situation. 


♦Native vegetation is defined as rangelands, pastures, and grasslands in this 
study of the Great Plains. 
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2. APPLICATION AND EVALUATION 


2.1 APPROACH 

2.1.1 RESEARCH DATA SET 

The research data set consisting of thirteen 5x6 nautical mile sample 
segments of Landsat MSS data was selected based on requirements establihsed 
for the overall task - Native Vegetation as an Indicator of Crop Moisture 
Condition. The process conmenced with a review of over 200 United States 
Great Plains segments from the Large Area Crop Inventory Experiment (LACIE) 
data set. 

Figure 1 illustrates the details of the data set selection process. 
Segments were evaluated based on the availability of consecutive years of data 
and adequate growing season acquisition histories. The final steps included 
examining aerial photography and plotted maps in order to obtain as much 
inter-segment diversity as possible in the study area. 

A brief description of the research data set is provided in Table 1 and 
the locations of the selected segments are shown on Figure 2. 

The following data products were assembled for each of the thirteen 
segments included in this task data set: 

1. Disk files of the multispectral four channel Image data. 

2. Production film converter (PFC) Product 1 (color IR composite of 
MSS bands 4, 5, and 7) for each acquisition. 

3. Color infrared photography at an approximate scale of 1:24 000 
accompanied by two Gerber plots (digitized field/crop overlay), 
one scaled to the photography and the other to the Product 1. 

4. A disk version of the universal ground truth tape (UGTT) of the 
digitized ground truth inventory. 
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Figure 2. - RESEARCH DATA SET LOCATIONS 
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5 USGS (United States Geologic Survey) maps at a scale of 
1:250 000 with the* iporopriate segment plotted. 

6. Other pertinent ancillary data such as crop statistics, cultiva- 
tion practices, crop calendars, geographic descriptions, and 
soils data. 

2.1.2 MASKING TECHNIQUE 

Masking was accomplished on a DEC PDP 11/70 computer system under the 
Interactive Application System (IAS) operating system using the Crop 
Condition Assessment processor (CCA). 

The masking technique developed by FAS/FCCAD [Ashburn (1979)] Is 
based on a single MSS acquisition that displays separability between 
native vegetation and cropland. Also, the assumption has been made that 
the cropland to native vegetation area ratio as delineated by the mask is 
static, relatively unchanged from year to year, and therefore, will be 
applicable for multiple acquisitions and years. 

The Ashburn Vegetative Index (2 t’mes Landsat Band 7 minus Band 5) Is 
used in mask creation because it is the primary VI used by FCCAD In 
operational masking. Aaronson, Davis and May (1979) concluded that the 
vegetative indices - AVI, DVI, Gvl, KVI, LAI, PVI and TVI - were highly 
correlated. Lautenschlager and Perry (1981) used variable clustering and 
functional equivalence techniques to arrive at the same conclusions. 

The procedure followed In masking native vegetation Is listed below: 

1. Using crop calendar Information to establish native vegetation 
and cropland separability, select an •mage acquisition date. 

2. Display the selected color IR Image acquisition date (Product 1) 
on the CCA's primary Image display screen and transfer the Image 
to the secondary screen. 

3. Create a gray scale AVI Image of the acquisition on the primary 


screen. 



4. Analyze the color IR image. Visually compare the color IR image 
and the gray scale AVI image. More than one color IR image may 
be analyzed in order to establish the area of interest. 

5. Using an alarm process available in IMDACS, establish a range of 
AVI values for the area of interest (native vegetation). 

6. Using the AVI values, create a black and white ima^e, a mask, 
for the area of interest. 

2.2 METHODS. RESULTS AND DISCUSSION 

2.2.1 MASKING ACCURACY 

The accuracies of the masks were determined by comparing each segment 
mask to the segment digitized ground truth. A mask/ground truth comparison 
map is shown in Figure 3. Accuracy proportion statistics were computed and 
output in table format. A simulation of these statistics appears in Appendix A. 

The ground truth is digitized to the sub-pixel level. There are six 
ground truth sub-pixels for every Landsat pixel. Accuracy statistics were 
computed at three levels based on the ground truth sub-pixel. The ground 
truth label for the all-pixel level, which totals 22,932 pixels, was 
determined by majority rule or the first pixel encountered basis [McIntyre 
(1982)]. The pure pixel statistics were computed on those pixels with six of 
six sub-pixels in crop code agreement. An overview of the data with a 
breakdown of mask/ground truth agreements to the sub-pixel level was also 
generated . 

The proportion of pixels in agreement ranged from .82 to .68 for all 
pixels in the scene, .86 to .69 for all pure pixels in the scene, and .83 to 
.47 for range ground truth pure pixels. Eight of the thirteen segments were 
undermasked. If the user is interested in pixel for pixel accuracy, the mask, 
judging from these statistics, is not a feasible alternative. 

Therefore, another approach was undertaken to evaluate the mask. In 
addition to the detailed sunmary statistics given in Appendix A, three 
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Figure 3: Partial Ground Truth/Mask Comparison Map, Segment 1266 
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different procedures were used to rank the thirteen segments for overall mask 
quality. These are described below. 

1. Professional judgment of mask quality: the analyst, without knowledge 
of the next two procedures, ranked the segments according to overall 
mask quality from best to worst. The analyst rankings are listed in 
column 1 of Table 2. 

2. Kendall's tau computed on agreement-disagreement of mask and ground 
truth: the tau coefficient proposed by Kendall (1948, 1955) is a 
measure of the extent of agreement between judges (mask and ground 
truth) . 

n agree - n disaqree 
t = ~ 2 n(n-l) 

i 

n agree - "disagree 
* n(n-l) n(n-l) 



From the last expression, one sees that tau can be thought of as the 
proportion of agreements minus the proportion of disagreements 
between the two rankings. Perfect agreement corresponds to a tau of 
1; perfect disagreement corresponds to a tau of -1, Lindeman (1980). 

The computed tau values for each segment and their respective 
rankings based on them are given in col unns 2 and 3 of Table 2. 

3. Fisher ranking information: this method provides a "measure" of the 
relative amount of information in the mask labels versus the ground 
truth labels which is available for estimating the range proportion 
"p." 
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S(p,a,e) 


( 




1 " 

a(l- ) 

+ S (1-a) 


Pa+ (l-p)(l-e) 

p(l-ct) + (l-p)B 


1 

- 


- 


where 

p = true proportion of range, 
a = probability of masking range as range, and 
& * probability of masking non-range as non-range 
The quantity S(p, a ,6 ) is between zero and one. It provides a mea- 
sure of the information loss induced by the uncertainty in the mask 
labels. For example, S(p, a , e ) = 0.42 means on the average there is only 
425 as much information in a mask label available for estimating the range 
proportion "p" as there is in a ground truth label. For a discussion of 
Fisher information in this context see Perry (1981). The relative Fisher 
information in the segment masks and the induced rankings are given in 
columns 4 and 5 of Table 2. 

By comparing col turns 1, 3, and 5 of Table 2, one observes that there 
is substantial agreement about mask quality as judged by the three proce- 
dures. The analyst professional judgment agrees with the tau ranking ex- 
cept for one inversion (the ordering of segments 1059 and 1596). There is 
less agreement between the analyst-Fisher and Fisher- tau rankings, but 
even in these pairs, the basic ordering is generally the same. Our sub- 
jective evaluation that the three procedures are similar is confirmed by 
treating each of three ranking systems as judges and computing Kendall's 
tau coefficient for each pair of rankings. The total number of agree- 
ments, tau, and the significance level for tau is given for each pair in 
Table 3. From the sample statistics one concludes that the ranking of the 
mask quality in each pair are significantly related. Given the tau and 
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Table 2. - Masking Accuracy Analysis by Segment 
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Table 3. - Results of Using Kendall's Tau as a Measure of the Relations' - . 





significance level associated with the analyst-tau ranking systems (0.97 
and 0.0001), it would appear that the information the analyst is subjec- 
tively considering when judging mask quality is the same information num- 
erically captured by the tau ranking procedure. If this is in fact true, 
one concludes that the analyst's rankings are primarily based on the 
agreement-disagreement of mask versus ground truth as this is the only 
information used in computing the tau value for a segment mask. 

2.2.2 ERROR EVALUATION 

The causes or types of masking errors were evaluated by an analyst 
using the mask acquisition date PEC Product 1, the aerial photography, 
both Gerber plots, gray-scale ground truth map, the mask/ground truth 
comparison maps and other Product 1 acquisition dates necessary for image 
analysis. Types of errors were categorized, analyzed, and tabulated. 
Proportions were computed for each category based on the total number of 
disagreements between the ground truth and the mask for pure pixels. 

Table 4 summarizes the proportions of errors in each category. 

In considering the errors of omission (ground truth range not masked 
as range), the greatest proportion of the error was in the sparse 
vegetation (low density) category followed by the lush vegetation 
category. The AVI values for the pixels in these two categories fell 
outside the selected range of AVI values for the range masks. In many 
cases, areas of ground truth range were not vegetated and AVI processing 
as designed did not include them in the mask. Lush vegetation occurred 
along drainage ways and in Improved grasslands. Including these areas In 
the mask would have increased the commission error (ground truth non-range 
masked as range) since increasing the AVI value range would have masked 
other non-range areas as well. 

Fields with weeds or emerging vegetation were generally masked as 
range and were a leading cause of errors of conmisslon. Senescent vege- 
tation, (turning vegetation with low greenness) presented a confusion 
problem in four winter wheat segments-1059, 1583, 1596, and 1755. Alfalfa 
and hay were confusion crops that were masked as range in segements 1661, 
1686, 1694, and 1755. Field boundaries where grass grows along a fence 
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TABLE 4. MASKING ERROR EVALUATION PROPORTIONS 















































































































line were also masked as range, but were considered errors of commission. 
The mask in this case was performing accurately and as expected. 

These examples of error-type define the central cause of masking 
Inadequacy for absolute classification: no vegetation- type can be 
expected to possess a unique VIN range. Quantative interpretation of 
LANDSAT MSS data has been checked by variations, both within scenes over 
time and between scenes. These variations may be produced by atmospheric 
processes as referenced by Cate (February 1980) or by physical parameters 
such as moisture content, row direction, soil background, shadows, and 
wind as summarized in a literature review by Cate (January 1980). On most 
of the segments, the analyst questioned some of the ground truth inventory 
or the ground truth registration. Many of the segments had areas that 
were unidentified or undefined which may have been correctly masked range 
but due to the ground truth inadequacies were considered in error. 

Evaluation of the types of errors leads to the assumption that the 
masking technique performed relatively well. The ground truth represents 
a definite yes/no situation, but it is evident that the actual situation 
is less decisive. The mask perhaps produces a more accurate "picture" of 
what is "actually" in the ground truth Inventory. 

2.2.3 PROFILE COMPARISON 

Another method of comparing the mask and the ground truth is plotting 
by segnent the computed AVI mean values for the mask and the ground truth 
for all acquisitions for a year versus time. 

Segment 1755, Jerauld County, South Dakota, statistically had one of 
the lowest proportions of mask/ground truth agreement, and segment 1003, 
Adams County, Colorado, had one of the highest proportions of mask/ground 
truth agreement. The range mask and range ground truth AVIs for both 
segnents show little difference in their respective profiles or values 
(see Figures 4 and 5). This is true of all segments and years. 
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Figu.e 5. - AVI vs. TIME PLOT FOR RANGE MASK AND RANGE GROUND TRUTH VALUES FOR 
SEGMENT 1003, ADAMS COUNTY, COLORADO IN 1978. 


3.0 SUMMARY 


Masking Is a successful technique for the user Interested in a 
quick-look procedure expandable to large areas and sufficiently accurate 
for most operative requirements. This is a simple Interactive technique. 
The acquisition used for masking is critical as the area to be masked must 
be spectrally separable from the other areas. The types and causes of 
errors are consistent among segments when analyzing large amounts of data. 
The AVI vs. time profiles comparisons illustrate that the errors encoun- 
tered are not a hinderance to the utility of the masking technique. 
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APPENDIX A 

Summary of Mask/Ground Truth Accuracy Statistics 








































































































































TABLE A-2. PROPORTION STATISTICS FOR ALL PIXELS 





























































